DOCUMENT RESUME 



ED 079 181 



SO 005 853 



AUTHOR 
TITLE 



INSTITUTION 
REPORT NO 
PUB DATE 
NOTE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Martika'inen^ Marja 

Investigations into the Instructional Process: VII# 

Non--Verbal Behavior in Group Work Observational 

Technique and Typology of Pupils' Work. 

Helsinki Univ. (Finland) • .Inst. -9f Education* 

RB-32 

Seo 72 1 

24p. . ^ 

MF-$0.65 HC-$3.29 

Associative Learning; ♦Behavioral Science Research; 
Behavior Patterns; Case Studies (Education) ; 
♦Classroom Observation Techniques; Data Analysis; 
Educational Research; Grade 3; Group Behavior;. 
Instanictional Programs; ♦Interaction Prqcess 
Analysis; Intergroup Relations; Learning 
Characteristics;^ ♦Nonverbal Communication; ♦Student 
Behavior; Study Habits; Typology 
♦Finland 



ABSTRACT 

Videotaped group work lessons of an elementary school 
third grade class provide material for study of the non-verbal aspect 
of group behavior. _A system of activity categories is developed and a 
typology of pupils' working methods in group study distinguishes . 
types knd characteristic forms of activity. . The following activity 
categories are used in the case study: (1) Independent activity pp 
owi initiative^ (2) Collaboration, (3) HelpfiH activity, (4) 
Attention to task, (5) Search for knowledge, (6) Passive activity, 
^d (7) Disturbed activity. .Five dimensions which reflect a working 
type are noted: Independent, S lidarity,. Work-centered, Passive, and 
Disturbed. .Results of the study are analyzed and presented in graphic 
fom. It is found that the development of categories succeeded in 
terms of reliability and non- ambiguity, although validity was not 
established. . (SHM) * 
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Preface 

Seventh in the series "Investigations into the Instructional 
Process " appears the report of Mrs Marj a Mart ikainen on obser- 
vation of non-verbal behaviour in group work situations arising 
in the school class of our Institute, a class already familiar 
to readers of 'pr^svious reports in this series. 

Among systems of observational taxonomies developed for 
classroom interaction analysis, the vast majority and the best- 
known are based on the assumption that invariances of the in- 
structional process can be revealed mainly through an analysis 
of verbal behaviour. It is obvious that serious difficulties 
must be encountered in the classification and interpretation of 
verbal behaviour during early school years, yet very little has 
been done to investigate the possibility of removing these ob- 
structions by the use of non-verbal behaviour as a basis for 
classification. Here, in my opinion, lies the significance of 
the present report. 



Matt i Koskenni emi 



Institute of Education 
University of Helsinki 
September 1972 
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Investigations into the Instructional Procgss 

VII. Non-verbal Behaviour in Group Work 

Observa tior ^1 Technique and Typology of Pupils* Work 



1 . Backp.round and purpose 



When group worK behaviour is examined by observationc3l 
methods based on the verbal interaction process, no account 
is taken of how other group members act wh(^n the verbal be- 
haviour of one member is the suhjoct of attention. The pic- 
ture of group work and pupils' roles thus remains incomDlete. 
It is of special importance to record all activities, includ- 
ing non-verbal, of the pupil in cases vjhere the latter's 
verbal interaction is limited to a few responses only.- Obser- 
vation of verbal behaviour gives no picture of a pupil of 
this kind, although he may be one of the group's active mem- 
bers . 

The purpose of this study was to evolve a system of acti- 
vity categories v^hich could be used when observing the non- 
verbal aspect of group work* behaviour. The theoretical frame 
of reference is based on the general theory of Schaf f ens - 
unterricht introduced by Elsa Kohler in 1932, and on the 
general characteristics of social interaction as stated by 
Parsons (19f^8) and Bales (1951). There are methodological 
similarities between the activity categories used and the 
interaction analysis of Bales. The two will be used together 
at a later stage for the purpose of obtaining as complete a 
picture of group working as possible. A further aim of this 
study was to determine whether a typology of pupils' working 
methods in group work situations can be composed by means of 
the activity categories evolved. 
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2. Scheme of study 

2.1. Activity categories and pupils' working types 

Methodologically, activity categories are based on the 
interaction process analysis oi Bales (19511 and the CASES , 
categories of Spaulding (19701. The categories took their 
final form from empirical pilot studies. The task of evolv- 
ing pupils' working types \^as stimulated by Elsa Kohler'^ 
theory of Schaf fen sunt erricht and her activity typology. 

According to Bales, the activity unit observed is the 
smallest section of behaviour which can be regarded as 
significant for the group's othtjr members. Tlie essence of 
the method is that the activity of all group members is 
observed simultaneously, even if a change of activity occurs 
in one member cnly. In this way the dependence of members 
on 9ach other can be eliminated and results are not 'af fected 
by the dominating status of one member: d:ach member receives 
an equal number of codings during the lesson. In situations 
where the behaviour of all members remains the same for some 
time, unitization shifts to a basis of time, with activity 
divided into three-second periods for each member. This com- 
bination of two unitizing methods is essential if uniform 
working periods of longer duration are to be brought to 
light. 

The following activity categories of non-verbal behav- 
iour have been evolved: 

1. Independent activity on own initiative 

- planning 

- spontaneous reading, calculation, writing 

- creative activity 

2. Collaboration 

- mutual giving and taking 

- looking at each other 

- working together 

3. Helpful activity 

- any activity in which an individual 
offers help to another 

- response with show of feeling 
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4. Attention to task 

- attentive listening and watching 

- performance of task given by group members 

- concent rat ion on theme dealtwith 

- attention to procedure of teacher assisting 
group 

5, " Search for knowledge 

- action showing lack of knowledge required 
for solution of problem (e.g., putting up 
hand, looking at others' paoers) 

G. Pdssiveactivity 
if 

" passive"' ^' fol lowing work of group members 

7 . Disturbed activity 

- attention to occurrences outside group 

- eyes straying elsewhere 

- jumpiness , f umbl ing , f idget ing 

- teasing, disturbance. 

Five dimensions are distinguished, each of v^/hich reflects 
a working type. Types nnri their characteristic forms of activ 
ity are: 

I Independent working type corresponding to Kohler's 

^ creative type. Forms of activity characteristic of 

\ 

I this type are found in category 1. 

» 

j II Solidarity type, characterized by forms of behaviour 

I found in categories 2 and 3. 

! Ill Work-centred type corresponding to Kohlur's work type 

j Characteristic forms of activity found in categories 

j 4 and 5. 

1 IV Passive type, behaviour in accordance with category 6 

; V Disturbed type, activities as in category 7. 



\ 
I 

fx* 

I- 
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2>2. Subjects and materi al 

Material was videotaped from group work lessons of an 
elementary school third grade within tne University of Hel- 
sinki Institute of Education during the school year 1969-1970. 

Of the 16 group work lessons videotaped during the school 
year five were chosen for study, using the following criteria: 

a) the four subject matter areas in which lessons had be^n 
tape-recorded were rep re sen ted ; 

b) as many pupils as possible were included (16 out of 13); 

c) attendance of some pupils in two di f f eren t groups , en- 
abling comparisons to be made with regard to stability of 
working habits control pupils). 

All five groups contained four members of the same sex. 

Table 1. Suljjects of lessons and compos i tioti of groups 



Gro up 


Subject 




Length of 
lesson 


1 

Nature of task j 

i 


I 
II 
III 

IV 

V 


Finnish 
Divinity 
Arithmetic 
Divinity 

Civics' 


gi rls : 

KH, SLH, PJ, ST 
boys : 

OS, 3R3, K3, SEH 
boys : 

K3, AK, SEH, EL 
girls : 

PM, VM, 3K3, AR 
girls: 

SLH, 3K3, CB, KK 


33 '30" 
36' 

39 M 5" 
38 '15" 
3 1 M 5 " 


1 

Grammar repetition j 

i 

Story of Joseph 
Verbal problems 
Ten Commandments 
Ideal school 



The first three were actual problem-solution groups whose 
members performed tasks on the basis of what they had learnt. 
In the last tv:/o groups the finding of solutions was based on 
pupils' opinions, and answers as a rule were neither right nor 
wrong. 



t 



2.3. Observation 

Videotape was used always for observation of the activi- 
ties of two pupils simultaneously. A check was made at ten- 
unit 'i ntervals (on the average) to ensure that the pairs 
observec* werG in fact working simultaneously . In addition to 
the performer, the target was recorded. Units were coded in 
the seven categories v>/ith the aid of videotape and data ap- 
pearing on the coding form. 

r 

Unitizing reliability, which includes attributing reli- 
ability, was calculated by percentag3 index. A reliability 
of .78 was obtained for the whole material, the variation 
between groups being .03. The unitizing reliability of the 
method would exceed .00, however, if there were two simulta- 
neous observers from videotape. 

For categorizing reliability between two observers a 
figure of .08 was obtained by Scott's 11- coef f i cient . Reli- 
ability calculated by percentage index was .90, the figure 
varying by categories between .71 and 1.00. These .figures 
may be considered lo show sufficient objectivity in coding. 



3. Results 

3.1. Correlations between categories 

The correlcition matrix between categories (Table 2) ex- 
presses the interdependence of categories throughout group 
work lessons. The figures are so low that the categories may 
be considered sufficiently independent of each other to meet 
the requirement of independence imposed on the observational 
methods . 



Table 2. Correlation matrix between categories 



Cat. 


1 


2 




4 


5 


1 


1.00 










2 


-0.28 


1 .00 








3 


0.31 


0. 3e 


1 .00 






4 


-0.65 


0.42 


-0.25 


1 .00 




5 


0.05 


-0'.31 


-0.10 


-0.14 


1 .00 


6 


-0.51 


-0.21 


-0.21 


0.18 


0.02 


7 


-0.48 


0.43 


0.15 


0.21 


-0.31 



1 .00 
0.33 



1 .00 



3.2. Factor analysis 

The material was subjected to factorization by the 
principal axis method, and to rotation by the orthogonal 
varimax technique. Two, three and four factors were used 
with the varimax (Appendix 1), the solution reached with 
three factors being the most interpretable . 

The following factors were arrived at by interpretation: 

I 1. independent activity -0.65 
4. attention to task 0.82 

This was called the work concent rat ion factor . It cor^ 
responds to the supposed /work-centred type; in category 4, 
on the other hand, the influence of the fifth category does 
not appear. 

II 2. collaboration 0. 69 
3. helpfulactivity 0.49 
7. disturbed activity 0.56 

Despite the high 'load of category 7 the second factor is 
called the s olidarity factor . The inclusion of disturbed ac- 
tivity in it results from the nature of the lessons. During 
those lessons in v^/hich the most collaboration occurred, tasks 



f 

- B - 



demanded the expression of opinions and v;ere found difficult 
by pupils, who then became impatient, v^ifch a consequent in- 
crease of disturbed activity. The factor can be considered 
to reflect the supposed solidarity type. 

Ill 1 . independent activity . 0.55 
5. passive activity -0.73 
7. disturbe>d activity -0.47 

This is called the f^pctor of independent v^;orking or 
asceticism . It corresponds to the supposed independent ac- 
tivity type. 

Of the five supposed activity types the factors describe 
the first thrfee. Type the passive, emerges clearly in the 
third factor with a st ng ne'j^aHve^load. The disturbed type, 
on the contrary, cannot be clearly interpreted, at least in . 
the material in question. 

Table 3. Pupils' scores with the three interpreted factors 



Group I 



Group II 



Group III 



Group IV 



Group V 





II 


I 


III 


KH 


493 


442 


592 


SLH 


414 


441 


607 


P3 


470 


448 


526 


ST 


524 


29^} 


!^62 


OS 


446 


587 


295 


3R3 


455 


542 


499 


K3 


400 


443 


64 5 


StH 


497 


499 


455 


K3 


4 43 


378 


325 


AK 


379 


551 


4 74 


SEH 


306 


497 


635 


EL 


391 


560 


551 


PM 


575 


766 


527 


VM 


554 


. 597 


540 




611 


475 


369 


AR 


693 


559 


561 


SLH 


534 


578 


462 




677 


4 50 


534 


CB 


556 


393 


351 


KK 


573 


501 


409 



In groups I, II and III, v^/hich were of an actual 
problem-solution character, the factor scores given in 
Table 3 'show clearer results than in opinion groups. The 
behaviour of only one pupil seems to represent none of the 
types GSEH in group II). This pupi 1 however * was also 
present in group III, where his behaviour was cTearly in 
accordance with the third factor. 



3.3. Control pupils 

•The nature of a group work lesson and tasks, and the 
composition of a group have an effect on a pupil's behav- 
iour which is made clear by comparison of the profiles of 
conti^o] pupils. Factor and percentage profiles of control 
pupils are found on pages 10-11, and Scott's n figures be- 
tween the four profiles in Table 4. 

Table 4. Scott's 11 figures between percentage profiles 
^ of control pupils. 



SLH V 3K3 V . SEH III K3 III 



SLH I -.41 

3K3 IV +.08 

K3 II -.29 

SEH II -.33 



SLH was present in both the problem-solution and the 
opinion group. The discrepancies in her behaviour seem to 
arise from the differing nature of the groups and tasks. 

3K3 was in two similar opinion groups, but her status 
differed from that of other members. In group IV the other 
members excluded her for most of the lesson, v^hiie in group 
V^she acted as scribe. Discrepancies of her behaviour thus 
seem due to the differing composition of groups and member's 
roles. Differences of behaviour between KJ and SEH are main- 
ly due to the tasks given them and the enjoyment thereof. 



3,4, Examination of profiles 



Percentage profiles of groups were compared by means of 
Scott's n coefficient and by using the z-test to check dif- 
ferences in frequency of occurrence between categories. 

When percentage pro files between groups (Appendix 2 ) and 
n figures in Table 5 are examined, the similarity of problem 
solution groups as such (groups I, II and III) and, corre- 
spondingly, of opinion groups (IV and V) is to be noted. On 
the other hand, pro files of opinion groupsdiffer clearly 
from those of prob lem- so I'u t ion groups, except for the fairly 
high figure be^tween groups II. and IV. 

Table 5. Scott's H coefficients between groups 



Group 


I 


II 


III 


• IV 


V 


I . 


1 .00 


•11 


.50 


.10 


-.16 


II 




1 .00 


.53 




. 19 


III 






1 .00 


.11 


-.05 


IV 








1 .00 


•il 


V 










1 .00 



When the whole material was compared with each group by 
categories, it was noted that numerous statistically signif- 
icant differences occurred in each category. On the basis of 
the figures conclusions were drawn as to the forms of aktiv- 
ity characteristic of group working of various types. In 
actual problem-solution groups independent activity occurred 
more often in a statistically significant sense than in the 
materia 1 as a who le . Co rrespondi ngly , the share of collabora 
tion vjas significantly smal ler. In opinion groups the situa- 
tion was quite the contrary . 
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3.S. Comparison of phases 

Taking Bales' phase hypothesis as an example, lessons 
were divided into a first, middle and final phase, each of 
which Included one third of the activities occurring in a 
group work lesson. The purpose was to examine whether the 
shift from one part of a Lesspn to another occurred with 
any regularity when activity categories were used. When 
Scott's n figures between phases were calculated, they va- 
ried From .83 to .96, showing a similarity of distribution. 
FreQucncy in the occurrence of categories among phases and 
the whole material was checked by the z-test. The only cat- 
egory clearly distinguished in the different phases w*as 
disturbed activity (No. 7). Statistically, its frequency of 
occurrence grew in a highly significant manner towards the 
end of the lesson . 

' Also noticeable was a contrast between the first and 
last phase. In the first (division of work and familiar- 
ization with task), categories 2, 3, 4 and 6 occurred with 
a frequency above the average and category 7 with a fre- 
quency ht^lovv/ the average. In the last or finishing phase 
the situation was opposite. In the middle or actual working 
phase the occurrence of categories was evenly distributed. 
Only in a few cases, however, were dif f erences^statisti- 
cal ly sign if i cant . 

3.6* Performers of activities and targets 

Pupils were arranged in order of precedence by groups 
in accordance with the extent to which group members di- 
rected activities toward each of their fellov^/s. From per- 
formers of activities and targets percentage matrices were 
formed which also expressed for each member the number of 
activities directed to the group as a whole, to the task, 
to the teacher and to outsiders. 
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The number of activities addressed to the group as a 
whole was small, varying between 0 % and 4 % for individual 
pupils and 0 % and 3 % for groups. Low figures were the 
result of an observational method by which activities in- 
tended for the whole group or several' members are general- 
ly unitized to the individual member. 

Groups acted independently of the teacher, asking her 
advice or following her actions with regard to only 2-6 % 
of all activities. With individual pupils the f i gu're var- 
ied from 2 % to 8 % . 

The number of activities directed by pupils to edch 
other varied with the seating. Statistically significant 
interaction occurred more between those seated opposite each 
other than those seated side by side or obliquely opposite. 
When checked by the z-test, discrepancies were significant 
at the level of 0.1 %. Discrepancies did not appear between 
pupils sitting side by side or obliquely opposite. 

In actual problem -solution groups the member who accepted 
most activities had the highest load with the third or inde- 
pendent working factor. In opinion groups the first member 
had a high figure with the solidarity factor. Typical of 
those who received least attention in all groups was a low 
figure with the second or third or with both these factors. 

4 . Discussion 

This investigation vyas a case study, which makes gener- 
alization difficult. Its aim was to map out a problem area 
and to evolve an observational method for non-verbal behav- 
iour, not to test hypotheses. 

The development of categories succeeded in terms of reli- 
abi li ty^^and hon -amb igui ty . On the other hand, the low cor- 
relations of the starting matrix made factor analysis more 
difficult. The validity problem has not yet been dealt with; 



The method is limited in use because pictorial ™aterial 
is necessary for the performance cf observations, whi h s 
IS necesoa y increase unitizing reliabil- 

a lengthy process e«en then. To mere _ „ ^jm, m 
ity there should be at least two observers. ReUabiU y ^ 
aessi«c=tion, on the other hand, does not demanu a lengthy 

fcrainine for coders. 

T Jele.ents of S^haffens^nt^^ were clearly rev I d 

in the study. The effect of a_^H3liatin^±lH^ °" ^^^^^ ! 
m the stuay considerable in the light of 

ability to act independently is consioei 

. . M an Plementary school pupils 

rpsults. In the third grade of an eiementaiy 

hlP of acting ascreativejjl^^ P^"" 

•alreadv seem capable ot acrm^ as_ ^ r„„m_ 

. -i-v, Although groups v^/ere not form 

duced by independent activity. Although g P 

3ent a ,r,,ti,e^ because each ^^^^ 
fP with the factor of independent working. ResuKs 

is were able to act in accordance with the independent 

working type. distinguish the working types 

It was found possible to distmguis 

.crresponding to the worK type and creative 
K,hler.s activity typology, and. further - "/f 
unorganized type as to for. a passive and soUdar ty type. 

Owing to the scarcity of group work lessons, howev r. 
it i impossible fro. these results to .a.e generaUzat.o s. 
i h wo Id require the support of .ore extensive material. 



- 16 - 



References : 

BALES, R. F. 1951. Interaction Process Analysis . 
Cambridge : Addi son -Wesley . | 

KOHLER, ELSA. 1932. Entwicklungsgema'sser Schaf fen sunt err icht 
Wien: Deutscher Verlag fiSr Jugend und Volk. 

PARSONS, TALCDTT. 1968. "The Paradigm of Social Interaction" 
International Encyclopedia of the Social Sciences 
(Ed. David L. Sills) 429-470. 

SPAULDING, ROBERT L. 1970. Classroom Behavior Analysis and 
Treatment . San Jose State College. 



17 - 



Appendix 1 



Varimax technique - two factors' solution 



1 
2 
3 
4 
5 
6 
7 

Eigen- 
value 



1 

■0.814 
0.012 
•0.460 

0. eio 

0.011 

0. 620 
b. 331 

1 , 740 



•0.290 
0. 746 
0.381 
0.382 
•0.448 
•0. 106 
0.563 

1.461 



0.74B 
0.556 
0. 357 
0.518 
0.201 
0. 396 
0.427 

3.201 



Varimax technique - three factors' solution 





.1 


2 


3 




h2 


1 


-0.652 


-0. 137 


0.550 


0. 


747 


2 


0.303 


0.686 


0.116 


0. 


575 


3 


-0. 348 . 


0.487 


0. 195 


0. 


396 


4 


0.816 


0. 172 


-0. 106 


0. 


706 


5 


-0.062 


-0.450 


0.032 


0. 


207 


6 


0. 130 


-0.121 


-0. 727 


0. 


552 


7 


0. 136 


0.564 


-0.474 


0. 


561 


en - 

1 ■ a 


1 . 34 3 


1 .291 


1.119 


3. 


753 



Varimax technique ^ four factors', solution 
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1 


2 


3 




4 


h2 


1 


-0.648 


0.089 


0.569 


-0. 


060 


0.7,55 


2 


0.443 


0.509 


0.047 


0. 


353 


0.582 


3 


-0.201 


0.597 


0. 132 


0. 


127 


0.430 


4 


0.815 


-0.097 


-0. 123 


0. 


134 


0. 706 


5 


-0.079 


-0.123 


0.025 


-0. 


559 


0. 335 


6 


0.07 3 


-0.219 


-0.710 


-0. 


040 


0. 559 


7 


0.219 


0. 338 


-0. 51i6 


C. 


365 


0.561 


en- 
ue 


1 . 379 


0.810 


1 . 130 


0. 


610 


3.929 



1= 



Percentage ProFiles of the Groups 
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30. 



40 



50 



60 



Cat, 



Group IV 




Previous Itsutt in this Seriet 

No. 1 The Effectiveness of Punishments and the School Climate by OLLI SIR!- 
NEN. May, 1957. 10 pp. Out of print. 

No. 2 The Balance of Instructional Situations by Ma\TTI KOSKENNIEMI. Nov., 
1957 (reprint 1972). 7 pp. 

No. 3 On Deceit Practiced in Finnish Grammar Schools at Written Tasks by OLA- 
VI PAIVANSALO. Nov., 1957. 5 pp. Out of print. 

No. 4 Comparison between Reading Comprehension and Reading Aloud by 
KAISA HALINEN. March, 1958. 9 pp. Out of print 

' No. 5 Ten Test-Papers in the Swedish Language as Graded by Ten Teachers by 
VAIND HEIKKIf^EN & ANITA HAVELA. Sept., 1958. 5 pp. Out of print. 

No. 6 The Awarding of School Marks by TOIVO VAHERVUO. Sept., 1958. 5 pp. 
Out of print. 

No. 7 Some Comments on the Uniformity of tho 'Experimental Period* in the 
History of Soviet Education by MATTI KOSKENNIEMI. Feb., 1959. 18 pp. 
Out of print. 

No. 8 Motives for the Choice of the Teaching Profession Correlated with Success 
in the Entrance Examination and in Student Teaching by MATTI KOSKEN- 
NIEMI. Feb., 1960. 11 pp. Out of print. 

No. 9 One's Own Teacher and the Choice of Teaching Profession by MATTI 
KOSKENNIEMI & ElVI LIHTONEN. Sept., 1960. 14 pp. Out of print. 

No. 10 The Curriculum of School Mathematics and Mathematical Performance. An 
Experimental Study by PAAVO MALINEN. Sept., 1961. 50 pp. Out of print. 

No 11 Prognostic Value of Some Psychological Test Results Correlated with 
Student Teaching Marks by MARJA-LEENA KAYHTY. Dec, 1961. 10 pp. 
Out of print. 

No. 12 Factors Constituting Classroom Climate by OLLI SIPINEN. March, 1963. 
10 pp. Out of print. 

No. 13 On the Changes in the. Educational Attitudes-of Young Teacher by VAINO 
HEIKKINEN. March, 1963. 14 pp. Out of print. 

No. 14 Teacher Training in Retrospection. A Preliminary Report by VAiNO HEIK- 
KINEN. Feb., 1964. 21-pp. Out of print. 

No. 15 Placement of Young Elementary School Teachers by MATTI KOSKEN- 
NIEMI. May, 1965 (reprint 1972). 9 pp. 

No. 16 Some Problems in Combining the Individual Tutors' Marks into a Final Mark 
in Teaching Ability by JOHANNES ALIKOSKI. March, 1966. 25 pp. Out of 
print. 

No. 17 The Finnish Senior Secondary Research Project I. General Presentation 
of the Project and Its Original Subjects by ANNA-LIISA SYSIHARJU. 
Sept., 1967. 31 pp. 



No. 18 The Finnish Senior Secondary Research Project IL Departure from Junior 
Secondary and Transfer to Senior Secondary by ANNA-LIISA SYSIHARJU. 
Oct., 1967. 52 pp. Out of print. 

No. 19 Relationships between Absences from School and Certain Factors Related 
to School. A Study on Elementary School Grades Three to Six by PERTTI 
KANSANEN. Nov., 1967. 10 pp. 

No. 20 On the Anxiety Associated with School Attendance and the Grammar 
School Entrance Examination by EEVA PATJAS. May, 1968. 16 pp. 

No. 21 School Achievement and Personality. I: Design and Hypotheses, IV: Results 
and Discussion by ERKKI A. NISKANEN. Oct., 1968. 51 pp. 

No. 22 School Achievement and Personality. II: Operations at the Variable Level 
by ERKKI A. NISKANEN. Oct., 1968.. 124 pp. 

No. 23 School Achievement and Personality. Ill: Operations at the Factor Level 
by ERKKI A. NISKANEN. Oct., 1968. 39 pp. 

No. 24 The Effectiveness of Two Methods of Teaching Englich as a Foreign 
Language in Some Finnish Secondary Schools by DANIEL J. CASEV. Nov., 
1968. 37 pp. 

No. 25 The Learning of Elementary Algebra. An Empirical Investigation of the 
Results of Learning in a Simplified School Learning System by PAAVO 
MALINEN. Jan., 1969. 85 pp. 

No. 26 Investigations into the Instructional Process. I. Some Methodological 
Problems by MATT! KOSKENNIEMI and ERKKI KOMULAINEN in col- 
laboration with Anna-Kaarina Faick and Pentti Holopainen. Oct., 1969 
(reprint 1972). 35 pp. 

No. 27 Investig^itions into the Instructional Process. II. Objectivity of Coding in a 
Modified Flanders Interaction Analysis by ERKKI KOMULAINEN. Dec, 
1970. 26 pp. 

No. 28 Investigations into the Instructional Process. III. P-technique Treatment of 
Observational Data by ERKKI KOMULAINEN. Jan., 1971. 41 pp. 

No. 29 Investigations into the Instructional Process. IV. Teaching as a Stochastic 
Proces!5 by ERKKI KOMULAINEN. Feb., 1971. 24 pp. 

. No. 30 Investigations into the Instructional Process. V. Experiences with the Bellack 
Classification System by KAI KARMA. Jan., 1972. 16 pp. 

- - ) 

Not 31 Investigations into the Instructional Process. VI. Group Work as a Social 
Interaction Process. A Case Approach by PENTTI HOLOPAINEN. May, 
1972. 34 pp. 



Distribution by EDUCA r.y., Fabianinkatu 28, SF- 00100 Helsinki 10 



